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METHOD FOR CONTROLLING A region having a defined location. A program is broadcasted 

COMPUTER WITH AN AUDIO SIGNAL having embedded therein a routing signal having routing 

information contained therein. The routing signal is then 

This application is related to copending U.S. patent extracted from the broadcast. Thereafter, a personal com- 

application Ser. No. 09/151,471, entitled, "METHOD FOR 5 puteris controlled to allow a user to retrieve the information 

INTERFACING SCANNED PRODUCT INFORMATION from a storage region at the defined location, which defined 

WITH A SOURCE FOR THE PRODUCT OVER A GLO- location is located with the extracted routing information, 

BAL NETWORK" filed of even date herewith. providing it at the personal computer for use by the user. 

TECHNICAL FIELD OF THE INVENTION i 0 BRIEF DESCRIPTION OF THE DRAWINGS 



This invention is related to a method of computer control, 
and particularly for automatically directing a web browser 
application on the computer to retrieve and display infor- 
mation in response to an analog signal. 

BACKGROUND OF THE INVENTION 

With the growing numbers of computer users connecting 
to the "Internet/' many companies are seeking the substan- 
tial commercial opportunities presented by such a large user 
base. For example, one technology which exists allows a 
television ("TV*) signal to trigger a computer response in 
which the consumer will be guided to a personalized web 
page. The source of the triggering signal may be a TV, video 
tape recorder, or radio. For example, if a viewer is watching ^ 
a TV program in which an advertiser offers viewer voting, 
the advertiser may transmit a unique signal within the 
television signal which controls a program known as a 
"browser** on the viewer's computer to automatically dis- 
play the advertiser's web page. The viewer then simply 3Q 
makes a selection which is then transmitted back to the 
advertiser. 

In order to provide the viewer with the capability of 
responding to a wide variety of companies using this 
technology, a database of company information and Uni- 35 
form Resource Locator ("URL") codes is necessarily main- 
tained in the viewer's computer, requiring continuous 
updates. URLs are short strings of data that identify 
resources on the Internet: documents, images, downloadable 
files, services, electronic mailboxes, and other resources. 40 
URLs make resources available under a variety of naming 
schemes and access methods such as HTTP, FTP, and 
Internet mail, addressable in the same simple way. URLs 
reduce the tedium of "login to this server, then issue this 
magic command . . . " down to a single click. The Internet 45 
uses URLs to specify the location of files on other servers. 
A URL includes the type of resource being accessed (e.g., 
Web, gopher, FTP), the address of the server, and the 
location of the file. The URL can point to any file on any 
networked computer. Current technology requires the 50 
viewer to perform periodic updates to obtain the most 
current URL database. This aspect of the current technology 
is cumbersome since the update process requires download- 
ing information to the viewer's computer. Moreover, the 
likelihood for error in performing the update, and the 55 
necessity of redoing the update in the event of a later 
computer crash, further complicates the process. 
Additionally, current technologies are limited in the number 
of companies which may be stored in the database. This is 
a significant limitation since worldwide access presented by 50 
the Internet and the increasing number of companies con- 
necting to perform on-line commerce necessitates a large 
database. 

SUMMARY OF THE INVENTION 

65 

The present invention disclosed and claimed herein com- 
prises a method for retrieving information from a storage 



For a more complete understanding of the present inven- 
tion and the advantages thereof, reference is now made to 
the following description taken in conjunction with the 
accompanying Drawings in which: 

FIG. 1 illustrates a block diagram of the preferred 
embodiment; 

FIG. 2 illustrates the computer components employed in 
this embodiment; 

FIG 3 illustrates system interactions over a global net- 
work; 

FIGS. 4a-4e illustrate the various message packets trans- 
mitted between the source PC and network servers used in 
the preferred embodiment; and 

FIG. 5 is a flowchart depicting operation of the system 
according to the preferred embodiment. 

FIG. 6 illustrates a flowchart of actions taken by the 
Advertiser Reference Server ("ARS") server; 

FIG. 7 illustrates a flowchart of the interactive process 
between the source computer and ARS; 

FIG. 8 illustrates a web browser page receiving the 
modified URL/advertiser product data according to the 
preferred embodiment; 

FIG, 9 illustrates a simplified block diagram of the 
disclosed embodiment; 

FIG. 10 illustrates a more detailed, simplified block 
diagram of the embodiment of FIG. 9; 

FIG. 11 illustrates a diagrammatic view of a method for 
performing the routing operation; 

FIG. 12 illustrates a block diagram of an alternate 
embodiment utilizing an optical region in the video image 
for generating the routing information; 

FIG. 13 illustrates a block diagram illustrating the gen- 
eration of a profile with the disclosed embodiment; 

FIG. 14 illustrates a flowchart for generating the profile 
and storing at the ARS; and 

FIG. 15 illustrates a flowchart for processing the profile 
information when information is routed to a user. 

DETAILED DESCRIPTION OF THE 
INVENTION 

Referring now to FIG. 1, there is illustrated a block 
diagram of a system for controlling a personal computer 
("PC) 112 via an audio tone transmitted over a wireless 
system utilizing a TV. In the embodiment illustrated in FIG. 
1, there is provided a transmission station 101 and a receive 
station 117 that are connected via a communication link 108. 
The transmission station 101 is comprised of a television 
program source 104, which is operable to generate a pro- 
gram in the form of a broadcast signal comprised of video 
and audio. This is transmitted via conventional techniques 
along channels in the appropriate frequencies. The program 
source is input to a mixing device 106, which mixing device 
is operable to mix in an audio signal. This audio signal is 
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derived from an audio source 100 which comprises a coded 
audio signal which is then modulated onto a carrier which is 
combined with the television program source 104. This 
signal combining can be done at the audio level, or it can 
even be done at the RF level in the from of a different carrier. 
However, the preferred method is to merely sum the audio 
signal from the modulator 102 into the audio channel of the 
program that is generated by the television program source 
104. The output thereof is provided from the mixing device 
106 in the form of broadcast signal to an antenna 107, which 
transmits the information over the communication link 108 
to an antenna 109 on the receive side. 

On the receive side of the system, a conventional receiver 
110, such as a television is provided. This television pro- 
vides a speaker output which provides the user with an 
audible signal. This is typically associated with the program. 
However, the receiver 110 in the disclosed embodiment, also 
provides an audio output jack, this being the type RCAjack. 
This jack is utilized to provide an audio output signal on a 
line 113 which is represented by an audio signal 111. This 
line 113 provides all of the audio that is received over the 
communication link 108 to the PC 112 in the audio input 
port on the PC 112. However, it should be understood that, 
although a direct connection is illustrated from the receiver 
110 to the PC 112, there actually could be a microphone 
pickup at the PC 112 which could pick the audio signal up. 
In the disclosed embodiment the audio signal generated by 
the advertiser data input device 100 is audible to the human 
ear and, therefore, can be heard by the user. Therefore, no 
special filters are needed to provide this audio to the PC 112. 

The PC 112 is operable to run programs thereon which 
typically are stored in a program file area 116. These 
programs can be any type of programs such as word pro- 
cessing programs, application programs, etc. In the dis- 
closed embodiment, the program that is utilized in the 
system is what is referred to as a "browser." The PC 112 runs 
a browser program to facilitate the access of information on 
the network, for example, a global communication network 
known as the "Internet" or the World-Wide-Web ("Web"), 
The browser is a hypertext-linked application used for 
accessing information. Hypertext is a term used to describe 
a particular organization of information within a data pro- 
cessing system, and its presentation to a user. It exploits the 
computer's ability to link together information from a wide 
variety of sources to provide the user with the ability to 
explore a particular topic. The traditional style of presenta- 
tion used in books employs an organization of the informa- 
tion which is imposed upon it by limitations of the medium, 
namely fixed sized, sequential paper pages. Hypertext 
systems, however, use a large number of units of text or 
other types of data such as image information, graphical 
information, video information, or sound information, which 
can vary in size. A collection of such units of information is 
termed a hypertext document, or where the hypertext docu- 
ments employ information other than text, hypermedia 
documents. Multimedia communications may use the 
Hypertext Transfer Protocol ("HTTP"), and files or format- 
ted data may use the Hypertext Markup Language 
("HTML"). This formatting language provides for a min- 
gling of text, graphics, sound, video, and hypertext links by 
"tagging" a text document using HTML Data encoded 
using HTML is often referred to as an "HTML document," 
an "HTML page " or a "home page." These documents and 
other Internet resources may be accessed across the network 
by means of a network addressing scheme which uses a 
locator referred to as a Uniform Resource Locator ("URL"), 
for example, "http://www.digitalcom. ,, 
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The Internet is one of the most utilized networks for 
interconnecting distributed computer systems and allows 
users of these computer systems to exchange data all over 
the world. Connected to the Internet are many private 

5 networks, for example, corporate or commercial networks. 
Standard protocols, such as the Transport Control Protocol 
("TCP") and the Internet Protocol ("IP") provide a conve- 
nient method for communicating across these diverse net- 
works. These protocols dictate how data are formatted and 
communicated. As a characteristic of the Internet, the pro- 
tocols are layered in an IP stack. At higher levels of the IP 
stack, such as the application layer (where HTTP is 
employed), the user information is more readily visible, 
while at lower levels, such as the network level (where 
TCP/IP are used), the data can merely be observed as 

15 packets or a stream of rapidly moving digital signals. 
Superimposed on the Internet is a standard protocol interface 
for accessing Web resources, such servers, files, Web pages, 
mail messages, and the like. One way that Web resources can 
be accessed is by browsers made by Netscape® and 

20 Microsoft Internet Explorer®. 

Referring again now to FIG. 1, the user can load this 
program with the appropriate keystrokes such that a browser 
window wilt be displayed on a display 118. In one 
embodiment, the user can run the browser program on the 

25 PC 112 such that the browser window is displayed on the 
display 118. While watching a preferred program, the user 
can also view display 118. When an audio signal is received 
by the receiver 110 and the encoded information is contained 
therein that was input thereto by the advertiser, the PC 112 

30 will then perform a number of operations. The first 
operation, according to the disclosed embodiment, is to 
extract the audio information within the received audio 
signal in the form of digital data, and then transmit this 
digital data to a defined location on the global communica- 

35 tion network via a modem connection 114. This connection 
will be described hereinbelow. This information will be 
relayed to a proprietary location and the instructions sent 
back to the PC 112 as to the location of the advertiser 
associated with the code, and the PC 112 will then effect a 

40 communication link to that location such that the user can 
view on the display 118 information that the advertiser, by 
the fact of putting the tone onto the broadcast channel, 
desires the viewer to view. This information can be in the 
form of interactive programs, data files, etc. In one example, 

45 when an advertisement appears on the television, the tone 
can be generated and then additional data displayed on the 
display 118. Additionally, a streaming video program could 
be played on the PC received over the network, which 
streaming video program is actually longer than the adver- 

50 tising segment on the broadcast. Another example would be 
a sports game that would broadcast the tone in order to allow 
a user access to information that is not available over the 
broadcast network, such as additional statistics associated 
with the sports program, etc. 

55 By utilizing the system described herein with respect to 
the disclosed embodiment of FIG. 1, an advertiser is allowed 
the ability to control a user's PC 112 through the use of tones 
embedded within a program audio signal. As will descried 
hereinbelow, the disclosed embodiment utilizes particular 

60 routing information stored in the PC 112 which allows the 
encoded information in the received audio signal to route 
this information to a desired location on the network and 
then allow other routing information to be returned to the PC 
112 for control thereof to route the PC 112 to the appropriate 

65 location associated with that code. 

Referring now to FIG. 2, there is illustrated a computer 
204, similar to computer 112, connected to display infor- 
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mation on display 118. The computer 204 comprises an 
internal audio or "sound" card 206 for receiving the trans- 
mitted audio signal through receive antenna 109 and 
receiver 110. The sound card 206 typically contains analog- 
to-digital circuitry for converting the analog audio signal 5 
into a digital signal. The digital signal may then be more 
easily manipulated by software programs. The receiver 110 
separates the audio signal from the video signal. A special 
trigger signal located within the transmitted advertiser audio 
signal triggers proprietary software running on the computer 10 
204 which launches a communication application, in this 
particular embodiment, the web browser application located 
on the PC 204. Coded advertiser information contained 
within the audio signal is then extracted and appended with 
the address of a proprietary server located on the commu- 15 
nication network. The remote server address is in the form 
of a URL. This appended data, in addition to other control 
codes, is inserted directly into the web browser application 
for automatic routing to the communication network. The 
web browser running on PC 204, and communicating to the 20 
network with a through an internal modem 208, in this 
embodiment, transmits the advertiser information to the 
remote server. The remote server cross-references the adver- 
tiser product information to the address of the advertiser 
server located on the network. The address of the advertiser 25 
server is routed back through the PC 204 web browser to the 
advertiser server. The advertiser product information is 
returned to PC 204 to be presented to the viewer on display 
118. In this particular embodiment, the particular advertiser 
product information displayed is contained within the adver- 30 
tiser's web page 212. As mentioned above, the audio signal 
is audible to the human ear. Therefore the audio signal, as 
emitted from the TV speakers, may be input to the sound 
card 206 via a microphone. Furthermore, the audio signal 
need not be a real-time broadcast, but may be on video tapes, 35 
CDs, DVD, or other media which may be displayed at a later 
date. With the imminent implementation of high definition 
digital television, the audio signal output from the TV may 
also be digital. Therefore, direct input into a sound card for 
A/D purposes may not be necessary, but alternative inter- 40 
facing techniques to accommodate digital -to-digital signal 
formats would apply. 

Referring now to FIG. 3, there is illustrated a source PC 
302, similar to PCs 204 and 112, connected to a global 
communication network 306 through an interface 304. In 45 
this embodiment, the audio signal 111 is received by PC 302 
through its sound card 206. The audio signal 111 comprises 
a trigger signal which triggers proprietary software into 
launching a web browser application residing on the PC 302. 
The audio signal HI also comprises advertiser product 
information which is extracted and appended with URL 
information of an Advertiser Reference Server ("ARS") 308. 
The ARS 308 is a system disposed on the network that is 
defined as the location to which data in the audio signal 111 
is to be routed. As such, data in the audio signal 111 will 
always be routed to the ARS 308, since a URL is unique on 
the network system. Connected to the ARS 308 is a database 
310 of product codes and associated manufacturer URLs. 
The database 310 undergoes a continual update process 
which is transparent to the user. As companies sign -on, e.g., 
subscribe, to this technology, manufacturer and product 
information is added to the database 310 without interrupt- 
ing operation of the source PC 302 with frequent updates. 
When the advertiser server address URL is obtained from 
the ARS database 310, it and the request for the particular 
advertiser product information is automatically routed back 
through the web browser on PC 302, over to the respective 
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advertiser server for retrieval of the advertiser product 
information to the PC 302. It should be noted that although 
the disclosed invention discusses a global communication 
network, the system is also applicable to LANs, WANs, and 
peer-to-peer network configurations. It should be noted that 
the disclosed architecture is not limited to a single source PC 
302, but may comprise a plurality of source PCs, e.g., PC 
300 and PC 303. Moreover, a plurality of ARS 308 systems 
and advertiser servers 312 may be implemented, e.g., ARS 
314, and advertiser server A 316, respectively. 

The information transactions, in general, which occur 
between the networked systems of this embodiment, over 
the communication network, are the following. The web 
browser running on source PC 302 transmits a message 
packet to the ARS 308 over Path "A." The ARS 308 decodes 
the message packet and performs a cross-reference function 
with product information extracted from the received mes- 
sage packet to obtain the address of an advertiser server 312. 
A new message packet is assembled comprising the adver- 
tiser server 312 address, and sent back to the source PC 302 
over Path "B " A "handoff* operation is performed whereby 
the source PC 302 browser simply reroutes the information 
on to the advertiser server 312 over Path "C," with the 
appropriate source and destination address appended. The 
advertiser server 312 receives and decodes the message 
packet. The request-for-advertiser-product-information is 
extracted and the advertiser 312 retrieves the requested 
information from its database for transmission back to the 
source PC 302 over Path "D." The source PC 302 then 
processes the information, i.e., for display to the viewer. The 
optional Path "E" is discussed hereiobelow. It should be 
noted that the disclosed methods are not limited to only 
browser communication applications, but may 
accommodate, with sufficient modifications by one skilled in 
the art, other communication applications used to transmit 
information over the Internet or communication network. 

Referring now to FIG. 4a, the message packet 400 sent 
from the source PC 302 to ARS 308 via Path "A" comprises 
several fields. One field comprises the URL of the ARS 308 
which indicates where the message packet is to be sent. 
Another field comprises the advertiser product code or other 
information derived from the audio signal 111, and any 
additional overhead information required for a given trans- 
action. The product code provides a link to the address of the 
advertiser server 312, located in the database 310. Yet 
another field comprises the network address of the source 
PC 302. In general, network transmissions are effected in 
packets of information, each packet providing a destination 
address, a source address, and data. These packets vary 
depending upon the network transmission protocol utilized 
for communication. Although the protocols utilized in the 
disclosed embodiment are of a conventional protocol suite 
commonly known as TCP/IP, it should be understood that 
any protocols providing the similar basic functions can be 
used, with the primary requirement that a browser can 
forward the routing information to the desired URL in 
response to keystrokes being input to a PC. However, it 
should be understood that any protocol can be used, with the 
primary requirement that a browser can forward the product 
information to the desired URL in response to keystrokes 
being input to a PC. Within the context of this disclosure, 
"message packet" shall refer to and comprise the destination 
URL, product information, and source address, even though 
more than a single packet must be transmitted to effect such 
a transmission. 

Upon receipt of the message packet 400 from source PC 
302, ARS 308 processes the information in accordance with 
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instructions embedded in the overhead information. The 
ARS 308 specifically will extract the product code informa- 
tion from the received packet 400 and, once extracted, will 
then decode this product code information. Once decoded, 
this information is then compared with data contained within 5 
the ARS advertiser database 310 to determine if there is a 
"hit." If there is no "hit" indicating a match, then informa- 
tion is returned to the browser indicating such. If there is a 
"hit," a packet 402 is assembled which comprises the 
address of the source PC 302, and information instructing JQ 
the source PC 302 as to how to access, directly in a 
"handofl" operation, another location on the network, that of 
an advertiser server 312. This type of construction is rela- 
tively conventional with browsers such as Netscape® and 
Microsoft Internet Explorer® and, rather than displaying 15 
information from the ARS 308, the source PC 302 can then 
access the advertiser server 312. The ARS 308 transmits the 
packet 402 back to source PC 302 over Path "B " Referring 
now to FIG. 46, the message packet 402 comprises the 
address of the source PC 302, the URL of the advertiser 2Q 
server 312 embedded within instructional code, and the URL 
of the ARS 308. 

Upon receipt of the message packet 402 by the source PC 
302, the message packet 402 is disassembled to obtain 
pertinent routing information for assembly of a new message 25 
packet 404. The web browser running on source PC 302 is 
now directed to obtain, over Path "C," the product informa- 
tion relevant to the particular advertiser server 312 location 
information embedded in message packet 404. Referring 
now to FIG. 4c, the message packet 404 for this transaction 30 
comprises the URL of the advertiser server 312, the request - 
for-product-information data, and the address of the source 
PC 302. 

Upon receipt of the message packet 404 from source PC 
302, advertiser server 312 disassembles the message packet 35 
404 to obtain the request-for-product-information data. The 
advertiser server 312 then retrieves the particular product 
information from its database, and transmits it over Path "D" 
back to the source PC 302. Referring now to FIG. 4d, the 
message packet 406 for this particular transaction comprises 40 
the address of the source PC 302, the requested information, 
and the URL of the advertiser server 312. 

Optionally, the ARS 308 may make a direct request for 
product information over Path "E" to advertiser server 312. 
In this mode, the ARS 308 sends information to the adver- 45 
tiser server 312 instructing it to contact the source PC 302. 
This, however, is unconventional and requires more com- 
plex software control. The message packet 408 for this 
transaction is illustrated in FIG. 4e, which comprises the 
URL of the advertiser server 312, the request-for-product- 50 
information data, and the address of the source PC 302. 
Since product information is not being returned to the ARS 
308, but directly to the source PC 302, the message packet 
408 requires the return address to be that of the source PC 
302. The product information is then passed directly to PC ss 
302 over Path "D 

Referring now to FIG. 5, the method for detecting and 
obtaining product information is as follows. In decision 
block 500, a proprietary application running resident on a 
source computer PC 302 (similar to PC 204) monitors the 60 
audio input for a special trigger signal. Upon detection of the 
trigger signal, data following the trigger signal is decoded 
for further processing, in function block 502. In function 
block 504, the data is buffered for further manipulation. In 
decision block 506, a determination is made as to whether 65 
the data can be properly authenticated. If not, program flow 
continues through the "N" signal to function block 520 
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where the data is discarded. In function block 522, the 
program then signals for a retransmission of the data. The 
system then waits for the next trigger signal, in decision 
block 500. If properly authenticated in decision block 506, 
program flow continues through the "Y" signal path where 
the data is then used to launch the web browser application, 
as indicated in function block 508. In function block 510, the 
web browser receives the URL data, which is then auto- 
matically routed through the computer modem 208 to the 
network interface 304 and ultimately to the network 306. In 
function block 514, the ARS 508 responds by returning the 
URL of advertiser server 312 to the PC 302. 

In function block 516, the web browser running on the 
source PC 302, receives the advertiser URL information 
from the ARS 308, and transmits the URL for the product 
file to the advertiser server 312. In block 518, the advertiser 
server 312 responds by sending the product information to 
the source PC 302 for processing. 

The user may obtain the benefits of this architecture by 
simply downloading the proprietary software over the net- 
work. Other methods for obtaining the software are well- 
known; for example, by CD, diskette, or pre-loaded hard 
drives. 

Referring now to FIG. 6, there is illustrated a flowchart of 
the process the ARS 308 may undergo when receiving the 
message packet 400 from the source PC 302. In decision 
block 600, the ARS 308 checks for the receipt of the 
message packet 400. If a message packet 400 is not received, 
program flow moves along the "N" path to continue waiting 
for the message. If the message packet 400 is received, 
program flow continues along path "Y" for message pro- 
cessing. Upon receipt of the message packet 400, in function 
block 602, the ARS 308 decodes the message packet 400. 
The product code is then extracted independently in function 
block 604 in preparation for matching the product code with 
the appropriate advertiser server address located in the 
database 310. In function block 606, the product code is then 
used with a look-up table to retrieve the advertiser server 
312 URL of the respective product information contained in 
the audio signal data. In function block 608, the ARS 308 
then assembles message packet 402 for transmission back to 
the source PC 302. Function block 610 indicates the process 
of sending the message packet 402 back to the source PC 
302 over Path "B." 

Referring now to FIG. 7, there is illustrated a flowchart of 
the interactive processes between the source PC 302 and the 
advertiser server 312. In function block 700, the source PC 
302 receives the message packet 402 back from the ARS 308 
and begins to decode the packet 402. In function block 702, 
the URL of the advertiser product information is extracted 
from the message packet 402 and saved for insertion into the 
message packet 404 to the advertiser server 312. The mes- 
sage packet 404 is then assembled and sent by the source PC 
302 over Path "C" to the advertiser server 312, n function 
block 704. While the source PC 302 waits, in function block 
706, the advertiser server 312 receives the message packet 
404 from the source PC 302, in function block 708, and 
disassembles it. The product information location is then 
extracted from the message packet 404 in function block 
710. The particular product information is retrieved from the 
advertiser server 312 database for transmission back to the 
source PC 302. In function block 712, the product informa- 
tion is assembled into message packet 406 and then trans- 
mitted back to the source PC 302 over Path "D." Returning 
to the source PC 302 in function block 714, the advertiser 
product information contained in the message packet 406 
received from the advertiser server 312, is then extracted and 
processed in function block 716. 
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Referring now to FIG. 8, after receipt of a trigger signal, running thereon to "fetch" the remote information at the 

a web browser application on a source PC 302 is automati- node 912 over the network 910 for display to the user 908. 

cally launched and computer display 800 presents a browser This routing information 904 is in the form of an embedded 

page 802. Proprietary software running on the source PC code within the audio signal, as was described hereinabove. 

302 processes the audio signal data after being digitized 5 Rekning now t0 F[G . 10) there is illustrated a more 

through the sound card 206 The software appropriately detaUed block di of ^ embodimem of FIG 9 In ^ 

prepares the data for uisertion directly into the web browser embodiment; ^ PC 906 is split up mt0 a of nodes> 

by extractuig the product information code and appending & fot pc 10 „ 2 ^ a Mcond pc 1(m ^ pc 1002 resMes 

keystroke data to this information. First, a URLpage 804 is at me node , asoeiMM with me ^ 908> aQd ae PC 1004 

opened in response to a Ctrl-O command added by the 10 resMes a , node ^ pc 1(m esents ^ ^ 

proprietary software as the first character string. Opening m of p[G 3 ^ pc m4 has a database 1006 associated 

URL page 804 automatically positions the cursor m a field which k basically the advertiser datab ase 310. 

806 where additional keystroke data following the Ctrl-0 Therefore, mere are mree nodes on the network 910 neoes . 

command will be inserted. After URL page 804 >s opened, tQ ^ lement lhe ^closed embodiment, the PC 1002, 

^ P ro '°« ,1 .P/ eamble hu Ptf » inserted into the 15 ^ pc i(m and (he nmote Mormation node 912 . ^ 

field 806. Next URL information associated with the loca- roud information 904 * utfli2ed by ^ PC 1002 for 

T^°i™f£? ! 8 K lnS ! f le i ml ° fel F « U0W1Dg th t ro^Qg t° ^ PC 1004 to determine the location of the 

ARS 308 URL data are the characters /? to aUow entry of remote information Qode 912 on the network 9m m k 

variables ^mediately following the ^characters. In this returned to the PC 1002 and a connection made directly with 
embodiment, the variable following is theproduct rnforma- M (he Kmols information node 912 and the i n f ormation 
tion code received in the audio signal The product code retfieved thctebom to ^ ^ 908 ^ rollti information 
mformation also provides the cross-reference information m basica]1 constitutes primlry rollting information, 
for obtaining the advertiser URL from the ARS database _ . . ^ T ^, ' , . 
310. Next, a carriage return is added to send the URL/ Referring now to FIG. 11, there is Ulustrated a diagram- 
product data and close the window 804. After the message „ matic . vie w of h ° w the network packet is formed for sending 
packet 400 is transmitted to the ARS 308 from the source PC P nmar y routln S "tfo™^™ to the PC 1004. In general 
302, transactions from the ARS 308, to the source PC 302, P_ runat y r°"tmg ^formation occupies a single field 
to the advertiser server 312, and back to the source PC 302, * mch P™"* ? 0 L utln S mfonnaUon is then assembled into a 
occur quickly and are transparent to the viewer. At this point, data P ack * Wlth th f ™ utlI ?S for 
the next information the viewer sees is the product infor- 30 transfer to the network 910. This is descnbed hereinabove m 
mation which was received from the advertiser server 312. c 

Referring now to FIG. 9, there is illustrated a block Referring now to FIG. 12, there is illustrated an alternate 

diagram of a more simplified embodiment. In this embodiment to that of FIG. 9. In this embodiment, the video 

embodiment, a video source 902 is provided which is source 902 has associated therewith an optical region 1202, 

operable to provide an audio output on an audio cable 901 35 which °P tical re B ion 1202 has disposed therein an embedded 

which provides routing information referred to by reference video °° d ^ ^ embedded video code could be relatively 

numeral 904. The routing information 904 is basically complex or as simple as a grid of dark and white regions, 

information contained within the audio signal. This is an each ™& ion ™ ^ & id able to have a dark color for a lo 8 ic 

encoded or embedded signal. The important aspect of the " r or a wnite re g ion for a lo & c "°" ^ wiu allow a 

routing information 904 is that it is automatically output in 40 value t0 be dis P osed wilhin ^ °P tic al region 1202. Asensor 

realtime as a function of the broadcast of the video program 1204 can ^en be provided for sensing this video code. In the 

received over the video source 902. Therefore, whenever the example above, this would merely require an array of optical 

program is being broadcast in realtime to the user 908, the detectors, one for each region in the grid to determine 

* routing information 904 will be output whenever the pro- whether this is a logic "1" or a logic "0" state. One of the 

ducer of the video desires it to be produced. It should be 45 sensed video * ^ 0Ut P ut t0 Ae PC 906 for Pressing 

understood that the box 902 representing the video source thereof t0 Pennine the information contained therein, 

could be any type of media that will result in the routing which information contained therein constitutes the primary 

information being output. This could be a cassette player, a routm g information 904. Thereafter, it is processed as 

DVD player, an audio cassette, a CD ROM or any such described hereinabove with reference to FIG. 9. 

media. It is only important that this is a program that the 50 Referring now to FIG. 13, there is illustrated a block 

producer develops which the user 908 watches in a continu- diagram for an embodiment wherein a user's profile can be 

ous or a streaming manner. Embedded within that program, forwarded to the original subscriber or manufacturer. The 

at a desired point selected by the producer, the routing PC 906 has associated therewith a profile database 1302, 

information 904 is output. which profile database 1302 is operable to store a profile of 

The audio information is then routed to a PC 906, which 55 the user 908. This profile is created when the program, after 

is similar to the PC 112 in FIG. 1. A user 908 is interfaced initial installation, requests profile information to be input in 

with the PC to receive information thereof, the PC 906 order to activate the program. In addition to the profile, there 

having associated therewith a display (not shown). The PC is also a unique ID that is provided to the user 908 in 

906 is interfaced with a network 910, similar to the network association with the browser program that runs on the PC 

306 in FIG. 3. This network 910 has multiple nodes thereon, 60 906 * Tnis ^ st °red in a storage location represented by a 

one of which is the PC 906, and another of which is block 1304. This ID 1304 is accessible by a remote location 

represented by a network node 912 which represents remote as a "cookie" which is information that is stored in the PC 

information. The object of the present embodiment is to 90 ^ in an accessible location, which accessible location is 

access remote information for display to the user 908 by the actually accessible by the remote program running on a 

act of transmitting from the video program in block 902 the 65 remote node. 

routing information 904. This routing information 904 is The ARS 308, which basically constitutes the PC 1004 of 

utilized to allow the PC 906 which has a network "browser" FIG. 10, is operable to have associated therewith a profile 
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database 1308, which profile database 1308 is operable to Once all of the information is collected, in either the basic 

store profiles for all of the users. The profile database 1308 mode or the more specific mode, the program will then flow 

is a combination of the stored in profile database 1302 for all to a function block 1412 where this information is stored 

of the PCs 906 that are attachable to the system. This is to locally. The program then flows to a decision block 1414 to 

be distinguished from information stored in the database 5 ^ n g° on-line to the host or the ARS 308. In general, the 

310, the advertiser's database, which contains intermediate user is prompted to determine whether he or she wants to 

destination tables. When the routing information in the send this information to the host at the present time or to 

primary routing information 904 is forwarded to the ARS send it later. If he or she selects the "later" option, the 

308 and extracted from the original data packet, the look-up program will flow to a function block 1415 to prompt the 

procedure described hereinabove can then be performed to 10 user at a l ater ume t0 sen d the information. In the disclosed 

determine where this information is to be routed. The profile embodiment, the user will not be able to utilize the software 

database 1302 is then utilized for each transaction, wherein until the profile information is sent to the host. Therefore, the 

each transaction in the form of the routing information user may have to activate this at a later time in order to 

received from the primary routing information 904 is com- connect with the host. 

pared to the destination tables 310 to determine what manu- 15 If the user has selected the option to upload the profile 
facturer it is associated with. The associated ID 1304 that is information to the host, the program will flow to the function 
transmitted along with the routing information in primary block 1416 to initiate the connect process and then to a 
routing information 904 is then compared with the profile decision block 1418 to determine if the connection has been 
database 1308 to determine if a profile associated therewith made. If not, the program will flow along a "N" path to a 
is available. This information is stored in a transaction 20 time to decision block 1420 which will time to an error block 
database 1310 such that, at a later time, for each routing code 1422 or back to the input of the connect decision block 1418. 
received in the form of the information in primary routing The program, once connected, will then flow along a "Y" 
information 904, there will associated therewith the IDs path from decision block 1418 to a function block 1428 to 
1304 of each of the PCs 906. The associated profiles in send the profile information with the ID of the computer or 
database 1308, which are stored in association with IDs 25 user to the host. The ID is basically, as described 
1304, can then be assembled and transmitted to a subscriber hereinabove, a "cookie" in the computer which is accessed 
as referenced by a subscriber node 1312 on the network 910. by the program when transmitting to the host. The program 
The ARS 308 can do this in two modes, a realtime mode or will then flow to a function block 1430 to activate the 
a non-realtime mode. In a realtime mode, each time a PC program such that it, at later time, can operate without 
906 accesses the advertiser database 310, that user's profile 30 requiring all of the set up information. In general, all of the 
information is uploaded to the subscriber node 1312. At the operation of this flowchart is performed with a "wizard" 
same time, billing information is generated for that sub- which steps the user through the setup process. Once 
scriber 1312 which is stored in a billing database 1316. complete, the program will flow to a Done block 1432. 
Therefore, the ARS 308 has the ability to inform the Referring now to FIG. 15, there is illustrated a flowchart 
subscriber 1312 of each transaction, bill for those 35 depicting the operation of the host when receiving a trans- 
transactions, and also provide to the subscriber 1312 profile action. The program is initiated at a start block 1502 and 
information regarding who is accessing the particular prod- then proceeds to decision block 1504, wherein it is deter- 
uct advertisement having associated therewith the routing mined whether the system has received a routing request, 
information field 904 for a particular routing code as i.e., the routing information 904 in the form of a tone, etc., 
described hereinabove. This information, once assembled, 40 embedded in the audio signal as described hereinabove with 
can then be transmitted to the subscriber 1312 and also be respect to FIG. 9. The program will loop back around to the 
reflected in billing information and stored in the billing input of decision block 1504 until the routing request has 
information database 1316. been received. At this time, the program will flow along the 
Referring now to FIG. 14, there is illustrated a flowchart "Y" path to a function block 1506 to receive the primary 
depicting the operation for storing the profile for the user. 45 routing information and the user ID. Essentially, this pri- 
The program is initiated in a block 1402 and then proceeds mary routing information is extracted from the audio tone, 
to a fiinction block 1404, wherein the system will prompt for in addition to the user ID. The program then flows to a 
the profile upon initiation of the system. This initiation is a function block 1508 to look up the manufacturer URL that 
function that is set to activate whenever the user initially corresponds to the received primary routing information and 
loads the software that he or she is provided. The purpose for 50 then return the necessary command information to the 
this is to create, in addition to the setup information, a user originating PC 108 in order to allow that PC to connect to 
profile. Once the user is prompted for this, then the program the destination associated with the primary routing informa- 
will flow to a decision block 1406 to determine whether the tion. Thereafter, the program will flow to a function block 
user provides basic or detailed information. This is select- 1510 to update the transaction database 1310 for the current 
able by the user. If selecting basic, the program will flow to 55 transaction. In general, the routing information 904 will be 
a function block 1408 wherein the user will enter basic stored as a single field with the associated IDs. The profile 
information such as name and serial number and possibly an database, as described hereinabove, has associated therewith 
address. However, to provide some incentive to the user to detailed profiles of each user on the system that has activated 
enter more information, the original prompt in function their software in association with their ID. Since the ID was 
block 1404 would have offers for such things as coupons, 60 sent in association with the routing information, what is 
discounts, etc, if the user will enter additional information. stored in the transaction database is the routing code, in 
If the user selects this option, the program from the decision association with all of the IDs transmitted to the system in 
block 1406 to a function block 1410. In the function block association with that particular routing code. Once this 
1410, the user is prompted to enter specific information such transaction database has been updated, as described 
as job, income level, general family history, demographic 65 hereinabove, the transactions can be transferred back to the 
information and more. There can be any amount of infor- subscriber at node 312 with the detailed profile information 
mation collected in this particular function block. from the profile database 1308. 
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The profile information can be transmitted back to the 
subscriber or manufacturer in the node 312 in realtime or 
non-realtime. A decision block 1512 is provided for this, 
which determines if the delivery is realtime. If realtime, the 
program will flow along a "Y" path to a function block 1514 5 
wherein the information will be immediately forwarded to 
the manufacturer or subscriber. The program will then flow 
to a function block 1516 wherein the billing for that par- 
ticular manufacturer or subscriber will be updated in the 
billing database 1316. The program will then flow into an 1Q 
End block 1518. If it was non-realtime, the program moves 
along the "N" path to a function block 1520 wherein it is set 
for a later delivery and it is accrued in the transaction 
database. In any event, the transaction database will accrue 
all information associated with a particular routing code. 15 

With a realtime transaction, it is possible for a manufac- 
turer to place an ad in a magazine or to place a product on 
a shelf at a particular time. The manufacturer can thereafter 
monitor the times when either the ads are or the products are 
purchased. Of course, they must be scanned into a computer 2 n 
which will provide some delay. However, the manufacturer 
can gain a very current view of how a product is moving. For 
example, if a cola manufacturer were to provide a promo- 
tional advertisement on, for example, television, indicating 
that a new cola was going to be placed on the shelf and that 25 
the first 1000 purchasers, for example, scanning their code 
into the network would receive some benefit, such as a 
chance to win a trip to some famous resort in Florida or some 
other incentive, the manufacturer would have a very good 
idea as to how well the advertisement was received. Further, 30 
the advertiser would know where the receptive markets 
were. If this advertiser, for example, had placed the televi- 
sion advertisement in ten cities and received overwhelming 
response from one city, but very poor response from another 
city, he would then have some inclination to believe that 35 
either one poor response city was not a good market or that 
the advertising medium he had chosen was very poor. Since 
the advertiser can obtain a relatively instant response and 
also content with that response as to the demographics of the 
responder, very important information can be obtained in a ^ 
relatively short time. 

It should be noted that the disclosed embodiment is not 
limited to a single source PC 302, but may encompass a 
large number of source computers connected over a global 
communication network. Additionally, the embodiment is 45 
not limited to a single ARS 308 or a single advertiser server 
312, but may include a plurality of ARS and advertiser 
systems, indicated by the addition of ARS 314 and advertiser 
server A 316, respectively. It should also be noted that this 
embodiment is not limited only to global communication 50 
networks, but also may be used with LAN, WAN, and 
peer-to-peer configurations. 

It should also be noted that the disclosed embodiment is 
not limited to a personal computer, but is also applicable to, 
for example, a Network Computer ("NctPC"), a scaled- 55 
down version of the PC, or any system which accommodates 
user interaction and interfaces to information resources. 

One typical application of the above noted technique is 
for providing a triggering event during a program, such as a 
sport event. In a first example, this may be generated by an 60 
advertiser. One could imagine that, due to the cost of 
advertisements in a high profile sports program, there is a 
desire to utilize this time widely. If, for example, an adver- 
tiser contracted for 15 seconds worth of advertising time, 
they could insert within their program a tone containing the 65 
routing information. This routing information can then be 
output to the user's PC which will cause the user's PC to, via 
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the network, obtain information from a remote location 
typically controlled by the advertiser. This could be in the 
form of an advertisement of a length longer than that 
contracted for. Further, this could be an interactive type of 
advertisement. An important aspect to the type of interaction 
between the actual broadcast program with the embedded 
routing information and the manufacturer's site is the fact 
that there is provided in the information as to the user's PC 
and a profile of the user themselves. Therefore, an advertiser 
can actually gain realtime information as to the number of 
individuals that are watching their particular advertisement 
and also information as to the background of those 
individuals, demographic information, etc. This can be a 
very valuable asset to an advertiser. 

In another example, the producer of the program, whether 
it be an on-air program, a program embedded in a video tape, 
CD-ROM, DVD, or a cassette, can allow the user to auto- 
matically access additional information that is not displayed 
on the screen. For example, in a sporting event, various 
statistics can be provided to the user from a remote location, 
merely by the viewer watching the program. When these 
statistics are provided, the advertiser can be provided with 
demographic information and background information 
regarding the user. This can be important when, for example, 
the user may record a sports program. If the manufacturer 
sees that this program routing code is being output from 
some device at a later time than the actual broadcast itself, 
this allows the advertisers to actually see that their program 
is still being used and also what type of individual is using 
it. Alternatively, the broadcaster could determine the same 
and actually bill the advertiser an additional sum for a later 
broadcast. This is all due to the fact that the routing 
information automatically, through a PC and a network, will 
provide an indication to the advertiser for other intermediary 
regarding the time at which the actual information was 
broadcast. 

The different type of medium that can be utilized with the 
above embodiment are such things as advertisements, which 
are discussed hereinabove, contests, games, news programs, 
education, coupon promotional programs, demonstration 
media (demos), photographs, all of which can be broadcast 
on a private site or a public site. This all will provide the 
ability to allow realtime interface with the network and the 
remote location for obtaining the routed information and 
also allow for realtime billing and accounting. 

Although the preferred embodiment has been described in 
detail, it should be understood that various changes, substi- 
tutions and alterations can be made therein without depart- 
ing from the spirit and scope of the invention as defined by 
the appended claims. 

What is claimed is: 

1. A method for controlling a computer disposed at a user 
location on a network, comprising the steps of: 
inputting an analog signal at the user location on the 
network, the analog signal comprising a commerce 
identifier, which commerce identifier has an association 
with information disposed on a remote information 
provider location on the network; 
in response to the step of inputting; 

appending routing information to the commerce 
identifier, which routing information defines the 
location of the remote information provider location 
on the network; 
creating a link between the user location and the remote 
information provider location over the network in 
accordance with the appended routing information, 
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which routing information defines the network con- 
nection between the user location and the remote 
Location on the network; and 
transmitting the commerce identifier from the user 
location to the remote information provider location 5 
over the network utilizing the created link, wherein 
the information associated with the commerce iden- 
tifier can be returned to the user location from the 
remote information provider location. 

2. The method of claim 1, wherein the analog signal is 10 
input to a sound card on the computer. 

3. The method of claim 1, wherein the step of appending 
routing information comprises the steps of: 

providing a database of routing information at a second- 
ary location on the network which provides an asso- 1 5 
ciation between a predetermined commerce identifier 
and a predefined remote information provider location 
on the network, there being a plurality of such routing 
information stored in the database; 

transmitting to the secondary location on the network the 20 
commerce identifier; 

accessing the database in response to receiving at the 
secondary location a transmitted commerce identifier 
from the user location; 

comparing the received commerce identifier with the 
stored routing information in the database; 

if there is a match between the received commerce 
identifier and any of the stored routing information, 
transmitting the matching routing information back to 30 
the user location; and 

at the user location, in response to receiving the matching 
routing information, appending the matching routing 
information to the commerce identifier. 

4. The method of claim 3, and further comprising the step 35 
of displaying the received information from the remote 
information provider location. 

5. Hie method of claim 1, wherein the network is a global 
communication network that provides a universal resource 
locator (URL) for each remote information provider location 40 
on the network and the routing information is comprised of 
the URL for the remote information provider location. 

6. The method of claim 1, wherein the appended routing 
information in the step of appending includes instructional 
information as to how the remote information provider 45 
location is to process the transmitted commerce identifier. 

7. A method for retrieving information from a storage 
region having a defined information provider location on a 
network, comprising the steps of: 

broadcasting a program having embedded therein an 50 
encoded signal having unique identifier information 
contained therein, wherein the unique identifier has an 
association with the location on the network of the 
storage region; 
extracting the encoded signal from the broadcast; and 
controlling a personal computer for a user at a user 
location on the network in response to the step of 
extracting to connect to the storage region on the 
network and retrieve information from the storage 60 
region at the defined location thereof on the network, 
which defined location is located with the extracted 
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encoded signal, and providing it at the personal com- 
puter for use by the user. 

8. The method of claim 7, wherein the personal computer 
has a display associated therewith, wherein the retrieved 
information is displayed on the display. 

9. The method of claim 7, wherein the broadcast program 
is a video program. 

10. The method of claim 7, wherein the broadcast pro- 
gram is an audio program. 

11. The method of claim 7, wherein the encoded signal 
comprises an audio signal and wherein the step of extracting 
comprises decoding the unique identifier information in the 
audio signal by the personal computer. 

12. The method of claim 11, wherein the broadcast 
program is a video program. 

13. The method of claim 11, wherein the broadcast 
program is an audio program. 

14. The method of claim 11, wherein the step of extracting 
routing information comprises connecting the video source 
to the personal computer with a cable which carries at least 
audio information, the personal computer then decoding 
from the audio information in the step of extracting the 
unique identifier information from the encoded signal, 

15. The method of claim 7, wherein the encoded signal is 
a video signal and the broadcast program is a video program 
and the step of extracting comprises extracting the unique 
identifier information from the video encoded signal. 

16. The method of claim 7, wherein the storage region is 
disposed on a remote information provider location on the 
network, and the step of controlling comprises: 

transferring the extracted unique identifier information to 
an intermediate node on the network; 

storing at the intermediate node on the network lookup 
information associated with the location of the storage 
region on the network with the unique identifier 
information, such that the unique identifier information 
is associated with the location of the storage region on 
the network; 

looking up at the intermediate node the associated loca- 
tion of the storage region for the received unique 
identifier information and returning the location infor- 
mation to the personal computer; and 

the step of controlling using the returned location infor- 
mation to retrieve information from the storage region 
at the defined remote information provider location on 
the network. 

17. The method of claim 16 and further comprising the 
step of storing at the intermediate node profile information 
associated with the user of the personal computer and 
storing at the personal computer identification information 
associated with the profile information at the intermediate 
node and further comprising the step of transmitting the 
identification information to the intermediate node when 
transmitting the unique identifier information thereto. 

18. The method of claim 17, and further comprising the 
step of transmitting profile information from the intermedi- 
ate node to the personal computer with the returned routing 
information, such that profile information is transmitted with 
the unique identifier information from the personal computer 
to the defined location on the network. 

* * * * * 



05/03/2003, EAST Version: 1.03.0002 



